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Abstract 

We develop a theory of 'special functions' associated to a certain fourth 
order differential operator X> M ,„ on R depending on two parameters fj,, v. 
For integers /it, v > —1 with [i + v 6 2No this operator extends to a 
self-adjoint operator on L 2 (R+, x^ +v+1 dx) with discrete spectrum. We 
find a closed formula for the generating functions of the eigenfunctions, 
from which we derive basic properties of the eigenfunctions such as or- 
thogonality, completeness, L 2 -norms, integral representations and various 
recurrence relations. 

This fourth order differential operator X> Mi „ arises as the radial part of 
the Casimir action in the Schrodinger model of the minimal representa- 
tion of the group 0(p, q), and our 'special functions' give isT-finite vectors. 
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1 Introduction 



Special functions have been a powerful analytic tool in various areas of math- 
ematics. One reason for their usefulness is the fact that there are a number 
of different aspects under which special functions simultaneously have good 
properties and admit explicit formulas (e.g. differential equations, orthonormal 
bases, recurrence relations, integral representations, etc.). Many of the classical 
special functions of this kind are associated to specific second order differential 
equations. In contrast, in this article we initiate the study of 'special functions' 
associated to the following fourth order differential operator 

V,, v := \ {{9 + u){9 + M + v) - x 2 ) (9(9 + fj,) x 2 ) - 

(1.1) 

with two parameters [i^v. Here 9 :— x-4- denotes the one-dimensional Euler 
operator. 

The differential operator T>^ M is symmetric with respect to the parameters 
fi and v, i.e. X> Mj „ = T> V4l (see Proposition 12.11 (1)). Further, if fj,, v > — 1 
are integers of the same parity, then the operator T>^ M extends to a self-adjoint 
operator on L 2 (R + , x' t+iy+1 dx) with discrete spectrum (see Proposition ^. II (4)). 
We then ask 

Question. What are the eigenj 'unctions of 'D^v ? 

The starting point for our search for cigenfunctions of T>^^ is the fact that 
the principal part of T)^ is a product of second order operators in the Weyl 
algebra. We will construct generating functions for eigenfunctions of T)^^ as 
modifications of products of generating functions for eigenfunctions of second or- 
der operators. More precisely, we introduce four generating functions G^' v (t,x) 
(i = 1, 2, 3, 4). Of particular importance for the L 2 -theory will be 

1 ~ / tx 



G£"(t,x) := - :, + „ +2 Js [ ^ ] K 



(i-ty 



l-t 2 v 1 -t 



where I a (z) := (§) a I a (z) and K a (z) := (§) a K a (z) denote the normalized 
I- and if-Bessel functions. (t, x) is real analytic at t = and we can define 
a family of real analytic functions A£ 'J(x) on M + (j G No) as the coefficients of 
the Taylor expansion 

oo 

In the L 2 -theory for the operator T>^ >v we have to assume the following inte- 
grality condition 

fi > v > — 1 arc integers of the same parity, not both equal to — 1. (IC1) 



Then we obtain the following result (for a proof see Proposition ^ . 11 (4). Corollary 
land Theorem [ 



Theorem A (L 2 -spectrum for £> Mjl /). Suppose fi and v satisfy (JTCTJ). Then the 
differential equation 



T>n,vU = Xu 
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has a non-trivial solution in I/ 2 (R+, x^ +v+1 dx) if and only if X is of the form 

/or some j G No- in i/i«s case the solution space in L 2 (R + , x^ +u+1 dx) is one- 
dimensional and spanned by A^j ■ 

Thus (|IC1[) implies that the functions A^'jix) (j G No) are orthogonal to 
each other. It is also possible to show completeness and to give explicit formulas 
for the L 2 -norms. In fact, Corollaries 14.81 and 16.21 yield 



Theorem B (Orthonormal basis). If fi and v satisfy (|IC1|) . then the sequence 
(Ag'^jeNo forms an orthogonal basis of L 2 (R + ,x tJl+u+1 dx). The I?-norms are 
given by 

||A ^ I|2 2 M+-i r (H±£±2 +i )r(^ + j) 



v 2,j \\L 2 (R + ,x^+"+ 1 dx 



We now drop the L 2 -condition and consider general eigenfunctions of T)^,v 
The other three generating functions Gf (t, x) (i = 1, 3, 4) are defined by similar 
formulas as G^ft, x) (see (|3.1[) - (|3.4[) ). but we have to impose an additional 
condition for i = 3, 4: 

fi is an odd integer > 1 for i = 3, 4. (IC2) 

Then again we can define a families of real analytic functions A^'^{x) on R + 
(j G Z) via the Taylor (i = 1,2), respectively Laurent (i = 3,4) expansions of 
G^' u (t,x). (It is convenient to set Af'^(x) = for i = 1,2 and j < 0, and for 
i = 3,4 and j < — /i.) 

The differential equation D^^u = Xu has a regular singularity at x = 
with characteristic exponents {0, — u, — /i, — /i — t/}. This allows us to prove the 
following theorem (cf. Theorems 14.21 and 14. 6j) : 



Theorem C (Differential equation). Suppose fi is a positive odd integer and 
v > such that [i — v 2Z. Then the four functions Afj(x) (i = 1,2,3,4) 
form a fundamental system of the following differential equation on R + : 

Furthermore, A^'jf (x) has the asymptotic behavior 

~ C\, C2X~ V , CzX~^ , CiX~^~ U 

as x — > 0, where the closed form of the constants Ci for i = 1, 2, 3, 4 is given in 
terms of Gamma functions. 

The differential operator X^,„ has an irregular singularity at x = oo. In 
Theorem 14.21 we also describe the asymptotic behavior of the eigenfunctions 
A^'^(x) as x — ► oo. In view of Remark l4.11l this also provides the asymptotics 
for x — > — oo. 

The functions Af'j have various other remarkable properties. First we men- 
tion the integral representations in terms of Laguerre polynomials L", which 
can be used to find the special values of A^'^(x) (i = 1, 2) at v = ±1 in terms 
of Laguerre polynomials (see Theorem 15.11 Corollary 15.31 and Remark 15. 4[) . 
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Theorem D (Integral representations). For j £ No, Re fi, Re v > —1 we have 
the following double integral representations 

A^(x) = cl'j [ f e- xcos *L~^(x(cos6 + cos(p))smL l 9sm^d^d8, 
Jo Jo 

A 2 j («) = 4j / / e - * coshL Pl, J 2 (a;(cos 6> + cosh tp)) sin' 1 6» sinh" y dip d6» 
Jo Jo 

with constants c^'J and c^'J. 

Another property of the functions A^ is that they are eigenfunctions of 
Meijer's G-transform T^ iV . Here 7^ is the integral operator given by 

W(*) : = ^TT jf ((f) 2 ) /(^ + " +1 dy 



where 



' 2' 2' 2 



denotes Meijer's G-function (see [1]). It is proved in [1] that, if /a, v > —1 arc 
not both equal to —1, 7^,„ is a unitary operator on L 2 (M. + ,x fJ ' +u+1 dx) and 
Tjj, = id. In particular, we have the following orthogonal decomposition into 
+1 and —1 eigcnspaces of 7^„: 

L 2 (R + , x» +v+1 dx) = H^ v ® H* v 

In Section [7] we prove: 

Theorem E (Meijer's G-transform). Suppose [i and v satisfy (|IC1|) . Then 
A^'j is an eigenfunction of Meijer's G-transform T^. v for the eigenvalue {— 1) J . 
Thus, {Aj'J : j £ 2No} forms an orthogonal basis for the Hilbert space Ti^ and 
{A^j '■ j € 2No + 1} forms an orthogonal basis for H.^" . 

Finally, the functions A^'" are subject to the following three recurrence re- 
lations (see Propositions 16. ll 16.51 16.71 for more details) : 

Theorem F (Recurrence relations). Let i = 1,2,3,4, j £ Z. 
(1) The three-term recurrence relation for x-^Af'^ : 

(2j + ul + l)6Atf = (j + l)(j + » + l)A£f +1 



- (2i + M + 1) (^±2) <f - (i + ^) (i + ^) A-U 

(2) T/ie recurrence relations in fi and v (see (|3.8|) /or i/ie definition of the 
signatures S(i),e(i) 6 { — 



f ,(A%(x)-A%_ 1 (x))=25(i) [a^(x)- (|) 2 A^(.t) 
^(A^-A^z)) = 2e(i) (a^" 2 (x)- (|) 2 A^ +2 (x)) , 
^ (A^(x) - A^_ x {xj) = 5{i)\A^{x)+e{t)\At : ; + \x). 
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(3) The five-term recurrence relation for x 2 A?'? (x) : 

,-.\;;;- >,k !:i {.v;;;':A- j 2 j + 2} 

At A -L M-l H±l M+j 
V J 7~ 2 ' 2 ' 2 ' 

Since the generating functions G^' v (t,x) are given in terms of Bessel func- 
tions, Theorems B and E give rise to identities for the I- and if-Bcssel functions 
and Meijer's G-function, some of which we could not trace in the literature (see 
Corollaries EM HH and E3J . 

Most of our proofs are of a purely analytic nature. A special role is played by 
generating functions. The approach to use the factorization of the principal part 
of the differential operator to construct generating functions might be useful also 
for other differential operators of a similar type. 

Our proofs for Theorems A, B and E, however, partly rely on representation 
theory, and for this reason we had to assume the integrality condition (|IC1[) . In 
fact, our operator T>^ v is induced from the Casimir action in the Schrodingcr 
model for the minimal representation of the scmisimplc Lie group G = 0(p, q) 
where p = /i + 3 and q = v + 3 when (IC1) is satisfied. This representation 
is realized on the Hilbert space L 2 (G), where C is an isotropic cone in R p+9_2 
and is parameterized by bipolar coordinates 

K+ x §^ +1 x § ,y+1 G, (r, oj, rj) h-> (rw, n?), 

where § ra_1 denotes the unit sphere in R™. Hence fx+1 and v + 1 play the role 
of dimensions of certain spheres if the integrality condition (|IC1[) is satisfied. In 
this case the functions A%'J are If -finite vectors of the representation and the 
recurrence relations in Theorem E can be explained by the Lie algebra action. 
The connection to Meijer's G-transform also arises from representation theory. 
In fact, the unitary integral transform T^ v is the radial part of the unitary 
inversion operator Tc on L 2 {C) defined by the special value of the minimal 
representation at the longest Weyl group element. This operator plays the role 
of a 'Fourier transform' on G. 

The special values of our parameters at v = ±1 are of particular interest. In 
this case, the functions A^ix) reduce essentially to Laguerre polynomials L^{x) 
(see Corollary 15.31 and Remark I5.4f> and the fourth order differential operator 
T>^ v is of the form 

£V,±l = S 1,±l + const ; 

where 5p,±i is basically the standard second order Laguerre operator of having 
A^'f 1 as eigenfunctions (see Remark |5.5|) . 

In the case v = — 1 the isotropic cone is the light cone in the Minkowski 
space which splits into the forward and backward cone. Correspondingly, the 
minimal representation of 0(p, 2) splits into a highest weight and a lowest weight 
representation which have been well-studied also in physics. For example, it may 
be interpreted as the bound states of the hydrogen atom when (n,v) = (1,-1), 
so that G = 0(4,2). 

On the other hand, in the case v = 1, it is noteworthy that Laguerre poly- 
nomials again occur as if-finite vectors of the minimal representations of the 
groups G = 0(p, 4) with even integers p > 4. In this case, the minimal repre- 
sentation was discovered not so long ago (see [TU] for 50(4, 4)), and it is known 
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to admit neither highest nor lowest weight vectors. 

Notation: N = {0,1,2,...}, Z = {...,-2,-1,0,1,2,...}, R+ = {x G R : 
x > 0}. 

2 The fourth order differential operator T>^ v 

In this section we collect basic properties on the fourth order differential operator 
T^ti,u with two parameters /i^gC which was introduced in (jl.ip . 

Proposition 2.1. (1) T>^^=T> V ^. 

(2) T>^ v u = Am is a differential equation with regular singularity at x = 0. 
T/ie characteristic exponents are 0, — /i, — f, —fj, — v. 

(3) ///i, v > —1, i/ien is a symmetric unbounded operator on the Hilbert 
space L 2 (R + , da;). //, m addition, fi > v > —1 are not &o£/i egwa/ 
to —1, the strictly increasing sequence (X^ ,v )j^ defined in (JT72J) belongs 
to the L 2 -spectrum ofT>^ M . 

(4) If /i and ^ satisfy the integrality condition (jTClJ, £/ien 2?^.„ extends to 
a self-adjoint operator on L 2 (R+,x fJ " +u+1 dx). It has discrete spectrum 
given precisely by (A^'^-gNo ■ Furthermore, every L 2 -eigenspace is one- 
dimensional. 

(5) In the special cases where v = ±1 the differential operator T> collapses 
to 



where 



<5(U,-1 



£V,±1 — <S/i,±l _ C^±l> 



1 ^ , ...^ ^ „ _ (m + i) 2 



:= - (0(0 + n + 2) + p + 1 - x 2 ) , C M , +1 
Proof. (1) A simple computation shows that 



= -^(<? + + v){6 + fj. + v) + x 



2 



2 { e 2 + (, + u + 2)e + ^±^t±^r l (2 . 1} 



whence X^j, = 
(2) It follows from fl2J} that 

x 2 (£V,„ - A) = 0(0 + fi)(9 + v){6 + fx + v) (mod x ■ C[x, 6}), 

where C[x, 6] denotes the left C[x]-modulc generated by 1, 6, 2 , . . . in the 
Weyl algebra C[x, -gj]. Therefore, the differential equation V^^u = \u 
has a regular singularity at x — 0, and its characteristic equation is given 

by 

s(s + //)(s + u)(s + /i + u) = 0. 
Hence the second statement is proved. 



G 



(3) The formal adjoint of 6 on L 2 {R + , x^ +v+1 dx) is given by 

9* = -9-{fx + u + 2). 

It is easily seen from the expression (|2.1[) that 2?^,^ is a symmetric operator 
on the same Hilbert space. We shall postpone the proof of the assertion 
that Xj' 1 ' is an L 2 -cigenvalue of 2? M .„ until Theorem 14.61 and Proposition 
I4.3[ where we give explicit eigenfunctions. 

(4) The proof of this statement is based on representation theory. We will 

postpone it to Section[51 where we explain how the fourth order differential 
operator T)^ arises from the Schrodinger model (the L 2 -model) of the 
minimal representation of the indefinite orthogonal group. 

(5) For v = — 1 this follows easily from by the commutator relation [6, -] = 

——. The case v — +1 is also obtained by a simple computation. □ 

Remark 2.2. It is likely that T>^^ is still (essentially) self-adjoint without 
assuming the integrality condition pCl[) . For example, for v = ±1 and arbitrary 
/i > —1 we will construct L 2 -eigenfunctions A^'^ 1 of 2?^,±i which are basically 
Laguerre polynomials (see Corollary 15.31 and Remark l5.4|) . Hence, they form a 
basis of the corresponding L 2 -space and it follows that 2?//,±i is self-adjoint with 
discrete spectrum. However, our proof for v ^ ±1 uses representation theory of 
the semisimplc Lie group 0(/i + 3,^ + 3) and hence uses condition pCip in a 
crucial way. 



3 The generating functions G^ ,v (t,x) 

To to determine eigenfunctions of the T>^^ v we define the following generating 
functions G^' v (t, x) i = 1, 2, 3, 4 

:= Z h^n h (l^) h (i^) ■ (3-D 
■ (^) , (3.2) 



Here 



1 


(1 


-t) 2 




1 


(1 


-t) 2 




1 


(1 


-t) 2 




1 


(1 


-t) 2 



~ f7\~ a J^-i 1 / 7 \ 2n 

«.)=-( 5 ) w = £ r(n+a+1)n , y . (3. 5 ) 



-' T(r 

=0 v 

Q (z) := f^y a Ka (z)=(^y a -£—(I. a (z)-I a (z)) (3.6) 
V 2 / V 2 / 2 sin a7r 



ra=0 

/ -y \ —a 

K, 



denote the normalized I- and A"-Besscl functions. 

Let us state the differential equations for the generating functions which we 
will make use of later. 
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Lemma 3.1 (Differential equations for the generating functions). The functions 
G^' v {t, x), i = 1,2,3,4, satisfy the following three differential equations: 
(1) The fourth order partial differential equation 



(I>r,u) x u(t, x) = Ue 2 t + 4( M + 1)0* + 



(ji-v)(ji + v + 2) 



u(t, x). 



(2) The second order partial differential equation 

(20t +H + l)(e x + M + ^ + 2 ) u(t, a?) 

1 „ ,„ , . ( „ t L + v + 2 



-0t(0 t + ii)-t[0t + 



(3) TTie /i/f/i order ordinary differential equation in t 



(i-v + 2 



u(t, x). 



8x z 



fi-1 



fi+1 



At + 3 



A 2 



% (0 t -i)(o t + n-i)(9t + n) \e t + 



u(t, x) 
/X — 5 



fj, + 1 

2 



A* + l 



2 ^< 
8t 



60? + c0 t 2 + d0 t + e) 



h + 



jU + 2 



M + 5 



2i 2 6» 



x I 

M + 7 



x t + 



At + f + 2 



z/ + 2 



A* - ^ + 2 



At-^ + 2 



A* - v + 4 



u(t, a:), 



where we set 



a = 6, 

&=12(a*+1), 
1 

C= 2 
1 

2 
1 

4 



d = 



(17Ai 2 -^ 2 + 36/i + 8), 
(A* + l)(5/i 2 -j/ 2 + 12^-4), 
(At -l)(/i + 2)(/z + v + 2) (a* - f + 2). 



Proof. The proof consists of straightforward verifications using the definition 
of Gi' v (t, x) and the differential equation 

(0 2 + 2a9 - z 2 )u = (3.7) 
for the I- and if-Bessel functions I a (z), K a (z) (see [TH Chapter III. 7]). □ 
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We will also need three recurrence relations for the functions G^' v {t,x). To 
state the formulas in a uniform way we put 



+ 1 fori = 1,2, 
-1 fori = 3, 4, 



s(i) 



+1 fori = 1,3, 
-1 fori = 2, 4. 



(3.8) 



Lemma 3.2 (Recurrence relations for the generating functions). The functions 
Gf' 1 '(f,x), i = 1,2,3,4, satisfy the following three recurrence relations: 

(1) The recurrence relation in fj. 

(2) The recurrence relation in v 

u(i- t )Gr(t,x) = (cr- 2 (t,x) - (f) 2 cr +2 (M)) • 

(3) The recurrence relation in n and v 

(1 - t)^Gr (t, x) = 5(i)^G? +2 '» + e{i) X -G^+\ 

Proof. (1) and (2): Use the recurrence relations for the I- and if-Bessel func- 
tions (see e.g. [H 111.71 (1)]) 

— ~ / x \ ^ — 

al a (x) = I a -i{x) - y-J I a+ i{x), 

aK a (x) = (J^j K a+ i(x) - K a -x(x). 
(3) In view of the formulas (cf. [HJ 111.71 (6)]) 



the equation is evident. 



~^K a (x) = ~K a+1 (x), (3.9) 

□ 



Lemma 3.3 (Parity formula for the generating functions). Suppose fx, v ^ 2Z. 
Then we have the following parity formula for the functions G^' l '(t,e~ 7T ^^-x) 

(% = 1,2,3,4;.- 





\ 






r 1 











\ 


or 








o„ 








or 




CT *) = 







ft,, 







v cr 


) 














) 



whe 



o. 



V GT / 



= r (1 - f) r( f ) 



(t,a:) 



Proof. From the definitions 
that 



and ()3.6|) of the Bessel functions it follows 
I a (x), 



I a {e 7! ^" l x 
K a (e Xy/=1 x) = a 2a K a (x) + b 2a I a (x) 7 
which proves the stated formula. 



□ 
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Remark 3.4 (Algebraic symmetries for the generating functions). It is also easy 
to see that the generating functions satisfy the following algebraic symmetries 

Gif v {t,x) = G^^,-x) (i=M), 



4 The eigenfunctions Aff (x) 

The function Kb (jzr[) is meromorphic near t = for a fixed x > if and only if 
/it is an odd integer. This explains the integrality condition pC2[l . which we will 
henceforth assume. Then the generating functions G^' v are meromorphic near 
t = and give rise to sequences (Af f)jez of functions on R + as coefficients of 
the Laurent expansions 

oo 

G!t' v (t, x) = * J 'A£r(*)> f = 2 . 3 > 4 - 



Since (z) is an entire function and Kb (z) has a pole of order fj, at 2; = if 
/i > 1 is an odd integer we immediately obtain 

= = for j < 0, 

A3,'; = K'j = for j < //. 

This allows us to calculate the functions Af ^ as follows: 



1 <9 J ' 

j! 3^ 



GftM) if i = 1, 2, j > 0, 

tPGffax) if* = 3,4,j>-M. 



(4.2) 



t=o 



Example 4.1. The L 2 -solutions A£ 'J(x) (i.e. the i = 2 case) will be of special 
interest. Here are its first three functions. 

A 2,'o» = ^g+a. ggfr), 



' (^ + ^ + 2)(/ i + z/ + 4) 
2T(^) V 4 



H ^ 0K<±{x) ^ -0 Kic[x) 

fi + 2 2 w m + 2 2 

To formulate the asymptotic behavior of the functions A^- (x) we use the 
Landau symbols O and o. 

Theorem 4.2. Let /j 6 C, /i ^ — 1, —2, —3, . . . and Assume further that 

J > if i ~ 1,2 and j > — /i ifi = 3, 4. 
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(1) The asymptotic behavior of the functions as x — > is given by 



2 13 



t£' v Ax) = — v J " + o(l) 



2 v - l v(^)x- v + o(x- v ) ifv>0, 



2 V 2 

v 



l-\ x -i>-» + o(x-^ v ) ifv>Q, 



2' 1 - z r[--jx-^ + o(x- fi ) ifv<o, 



where (a)„ = a(a + 1) • • • (a + n — 1) is i/ie Pochhammer symbol. 
(2) ^4s a; — > oo we /lave 

A^(x) = CfjV'-^e* f 1 + O , A^(x) = O (a^e*) , 

A£j» = C^-^e-" (l + O , A££(s) = O (,■' ■ < " ) 

constants C^'j , C^'j =/= 0. 

Proof. The basic ingredient for the proof is the asymptotic behavior of the 
Bessel functions at x = (see e.g. [T3] Chapters III and VII] and [TJ Chapter 

4]): 

7.(0) = p^Vl), (4-3) 

^(§)~ 2q + c(x- 2q ) ifa>0 
JT a (a) = { -log(|) + o(log(f )) if a = as x -> 0, (4.4) 



» 2 

2 



^=^-^o(l) ifa<0 



and as 



I a (x) = -±=(f) "~V fl + o' 



20F V2 

We will also make use of the well-known expansion 



(4.5) 



OO 



(i-*)" a = E^r* J '- ( 4 - 6 ) 



11 



(1) We show how to to calculate the asymptotic behavior at x = for the 
functions A%'j with v > 0. The same method applies to the other cases. 
Using the asymptotics (j4.3[) and (|4.4|) and the binomial expansion 
we find that 



*)Uo = ~ ' — j^(2(l - t))^ 



f i l2A 2 >J_ t j 



In view of ()4.1|1 this yields 

x v A^(x)| = M2jl 2 

2,/) v / ^— n 




(2) Let us first treat the case i = 1,2. With equation (|4.2[) it is easy to see 
that Af'" is a linear combination of terms of the form 

(x) for i = 1, 
(x) for i = 2 

with < k < j such that the coefficient for k = j are non-zero. (In 
fact this can be seen in a more direct way from the recurrence relation in 
Proposition 16.11 and Example 14.11 ) Using (|3.9p this simplifies to terms of 
the form 

f x 2k I% +k (x) for i=l, 
\ x 2k K^ +k {x) fori = 2 

with < k < j and non-zero coefficient for k = j. Using (|4.5p the leading 
term appears for k = j and the asymptotics follow. 

For i = 3, 4 equation (|4.2[) implies that is a linear combination of 
terms of the form 

x k -» (0 e I$) (x) for i = 3, 
jjo-n h l kA (x) fori = 4 

with < fc + £ < j + /x. Using (|3.9p this simplifies to terms of the form 

f a-fc+M-M^^^j for i = 3j 
\ x fe+2f ^A% +£ (x) for i = 4 

with < fc + £ < j + /i. Then again the claim follows from (14. 5p . □ 

As an immediate consequence of Theorem 14.21 we obtain 

Corollary 4.3. If fi > v are not both equal to —1, we have A^'J G L 2 (R + , x ^ +v+l 

From the explicit formulas for the leading terms of the functions A^ at 
x = we can draw two more important corollaries. 
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Corollary 4.4. The function A^- is non-zero if one of the following conditions 
is satisfied: 

• i = 1 and Li, 1/ > — 1. 

• i = 2 and /z > v > — 1 . 

• i = 3, 4, jU is a positive odd integer and v > — 1 such that fx — v ^ 2Z. 

Proof. Under the additional assumption that // and v are not both equal to 
— 1, in each case the assumption implies that the leading coefficient at x — 
in Theorem 14.21 is non-zero, so that the function itself is non-zero as well. The 
case fj, = v = — 1 only appears for £=1,2 and for these values of i the claim 
follows from the identities given in Corollary 15.31 □ 

Corollary 4.5. Suppose fi is a positive odd integer and v > such that /i — v^ 
2Z, then for fixed j £ No the four functions Af'j ', i = 1,2,3,4, are linearly 
independent. 

Proof. The assumptions imply that the leading coefficients at x = of the 
functions Af'"(x) in Theorem 14.21 never vanish and that the leading terms are 
distinct. Hence the asymptotic behavior near x = is different and the functions 
have to be linear independent. □ 

Now we can prove the main theorem of this section. 

Theorem 4.6 (Differential equation). For i = 1,2,3,4, j £ Z, the function 
Af?'? is an eigenfunction of the fourth order differential operator T)^^ for the 
eigenvalue X^' u (see equation (|1.2p ). If, in addition, \i is a positive odd integer 
and v > such that fi — v ^ 2Z, then for fixed j £ No the four functions A^ , 
i = l,2,3, 4, form a fundamental system of the fourth order differential equation 

Proof. In view of Corollary 14.51 it only remains to show the first statement. 
We deduce 

a,,a;;;' = \* v m% vj e z (4.7) 

from the corresponding partial differential equation for the generating function 
of both sides in (|4.7p . Clearly (T>^m)xG^ ' v (t, x) is the generating function for 
the left hand side of (|4.7[) . The generating function for the right hand side is 
calculated as follows 

oo 
j=—oo 

= £ (4i 2 + 4( M + l )i+ ^-^^ + - + 2 ) )^(,) 

j=— oo 

= ± U+^+m + ^-^v + ^ v^ix) 

j=-ao 
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where 9t ■= tjj. The resulting partial differential equation is 



AO 2 + 4( M + 1)0, + (M '" )0 : +t/ + 2r ) GT (t, a) 



which was verified in Lemma 13. II (1). 

Remark 4.7. Since T)^^ = 2?„. M by Proposition ^. II (1) and 



□ 



Theorem 14.61 implies that for fj, — v € 2Z also A 
D^.u for the eigenvalue . 



I'.ji 

i.j+t 



(x) is an eigenfunction of 



Corollary 4.8. If [i and v satisfy the integrality condition (|IC1|) . the system 
(Ag'^jeNo forms an orthogonal basis of L 2 (R + ,x^ +u+1 dx). 



PROOF. By Corollary |431 the functions Aft are contained in L (R+ , x 11 

and by Theorem 14.61 each function A^'j is an eigenfunction of for the 

eigenvalue \^' u . Therefore the claim follows from Proposition ^. II (4). □ 



Corollary 14.81 provides a completeness statement for Bessel functions we 
could not trace in the literature: 



Corollary 4.9. Fix an odd integer N > 1. Then for any integer — 1 < v < y 

the sequence (9 3 K^)j^ (resp. (x 2j K»+j)j£j$ ) is a basis for L 2 (M. + ,x N dx). 
The Gram-Schmidt process applied to this sequence yields the orthogonal basis 
(A 2 7" ' I/ ) J *eNo (up to scalar factors). 

Proof. Put fj, := N — v — 1, then \i and v satisfy (JTClJ . It is an easy con- 
sequence of the definitions that Aft can be written as a linear combination 

of the functions k K± for < k < j. (In fact this can be seen more directly 
from the recurrence relation in Proposition 16.11 ) Then the sequence (0 3 K<±)j 
clearly arises from the complete sequence (Aft)j by a base change and hence 

is complete. Using (|3.9p it is also easy to see that the second series (x 23 K% + j)j 

arises by a base change from the sequence {6 3 Kn)j. Finally, we note that both 
base change matrices considered arc upper triangular. Thus the Gram-Schmidt 

□ 



process in both cases yields the orthogonal basis A 2 



2,3 



We end this section with a parity formula for the functions A^J(x) which 
can be used to determine also the asymptotic behavior of as x — > — oo. The 
parity formula itself is an immediate consequence of Lemma [ 



Proposition 4.10 (Parity formula). Suppose fj,,i/ (£ 2Z. Then we have the 
following parity formula for the functions Af '"(<, e 7rv/=T x) (i = 1,2,3, 4, j G No )'■ 



/ A ft \ 

A ft 

Aft 
V Aft J 



[ 1 











b v 


a v 








K 





a it 





\ bfj,b v 


a^bft 







\ 


( Aft \ 




Aft 




Aft 


I 


^ Aft / 



(x) 



with non-zero coefficients a a , b a as in Lemma 
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Remark 4.11. If v is an odd integer, the functions A^(x) extend holomorphi- 
cally to C\{0}, not only to its universal covering. In this case, Proposition ^. 101 
expresses x) as linear combination of the functions A^'J(a;) (fc = 1, 2, 3, 4). 

The coefficients only contain a a and b a with a = 2n + 1 an odd integer (we 
assumed (|IC2j) ) and simplify significantly: 

02n+l = -1, hn+l = (-1)™ +1 7T. 

5 Integral representations 

In this section we show that for i = 1,2 the functions A^'^(x) have integral 
representations in terms of Laguerrc polynomials. Recall that for n £ Nq and 
aeC the Laguerre polynomial L"(x) is defined by (cf. [TJ (6.2.2)]) 

«M=£^(;;t:>* <-> 

k=0 v 7 

Theorem 5.1 (Integral representations). (1) For j £ Nq, Re /i,Re v > —1 
we have the following double integral representations 

A£?(x) = / / e^ a;cosv L7* i: (x(cos6' + cos^))sin^6lsin ,y v3d( / 9d6l, 

(5.2) 

A%$(x) = 4;- I I e~ x ^<P£^ir ( x ( cos e + cosh ^ sin M q sinh " ^ dyj dflj 

(5.3) 



Jo Jo 



7T /-OO 



JO 



with constants Cj 4 '- and c^',- given by 



ana c!> ■ 



' 1J ' 7rr(^)r(^±i) 2j ' r(«±i)r(2±i)" 



(2) For v = — 1 and Re /j > — 1 we aave 



Afr 1 ^) = cf 7 1 V e-(- 1 Y x L^(x(cos9+ (-1 



) i ))sin' 1 0d0, (5.4) 



A!£j 1 (x) = cife 1 j e~ x L^ (x{cos6 + l)) sin" (9 d6» (5.5) 







wii/i constants c^'j 1 and j 1 given by 

11,-1 _ 1 j _ _ 

^ 2^r(ii±i) 2j 2r(ii±i) 

Proof. Wc will make use of the formula (|4.2p for A^'" and the generating 
function of the Laguerre polynomials given by (see e.g. formula (6.2.4) in pQ) 

E L n^ tn =a-^ e ~^- (5 ' 6) 
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Further, we will need the following integral representations of Bessel functions 
for Re a > -\ (cf. formulas 111.71 (9) and VI. 15 (5) in Q3]) 



I a (x) 



K a (x) 



y/nT(a + 5 ) Jo 



-x cos 6 2a 



sin ZQ 6»d6», 



r(«+i) 



— /-oo 

^- / e~ xcosh¥, sinh 2Q ^d<p. 
+■ 5) Jo 



(5.7) 
(5.8) 



(1) Interchanging differentiation and integration we obtain the desired integral 



representations for A^'. 



H+l\ T fv+l 



7rr(^)r(^i) cp_ 

j\ dP 

1 d j 
J\ dP 



G? v (t,x) 



t=o (1 - *) 2 Jo Jo 



g — X COS tp 



JO 



1 # 



e - ^ cos e - ^ cos V gin ^ g gin ^ ^ dyJ d 
- (cos 0+cos tp) 



1 



(1-t) 



sin M 9 sin" <p dtp d0 



5 v i 2 (x(cos 6> + cos ip)) sin M sin" <p dip d9. 



For the functions At^'J we do a similar calculation: 



/!+l\ r ^+l 



r(^±i)r(^) a* 



.7! 



1 

j! dP 



dP 
1 



t=o (1-*) 2 Jo Jo 



cos — cosh cp 



' f3 ° ,1 # 

a; cosh <p __ 

j\ dP 



t=0 



sin M 9 sinh" c/? dp d9 

- (cos #+cosh ip) 



(1-t)' 



sin^ 1 sinh" p dp d9 

f f e- xcoshv L~^(x{cos9 + coshp))sm t *9smh' / pdpd9. 
Jo Jo 



(2) Using 



/ i(x) = —= coshx and K 1 (x) = e x , 



similar calculations as in (1) give the second part. 



(5.9) 
□ 
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Remark 5.2. The integral representations in Theorem 15. II (2) for the special 
case v = — 1 can also be obtained from the integral representations in part (1) 
for v > — 1 by taking the limit v — ► — 1. For example, to obtain the integral 
representation for Aj'" 1 we have to verify the limit formula 



(5.10) 



lim - * [ e- xcoshv 'cosh k <psmh' / wdw= -e~ x 
for < k < j. For k = the identity (|5.8[) turns the left hand side into 

-= lim K${x). 

The map a i— > JC Q (x) is continuous so (|5. 10|) follows from (|5.9p . For fc > and 
95 > we have 

cosh fc <p — cosh tp = cosh fc — 1 < sinh tp ■ p(sinh tp) 

with some polynomial p. Then one has to show that 

lim — TTT / e- xcosh *smh v+l+1 tpdtp = -e~ x . 



for I > 0. But this is easily seen using the integral representation (|5.8p and the 
continuity of the map a i— » 

As an easy application of the integral representations we give explicit ex- 
pressions for the functions A^- , i = 1, 2, in the case where v = — 1. 

Corollary 5.3. For f = —1 and /ieC arbitrary we have the following identity 
of meromorphic functions 

Proof. For the proof we may assume that Re /i > — 1. The general case 
fx € C then follows by meromorphic continuation. Note the identity (cf. formula 
16.6 (5) in [3J) 

1 (i - ,r - 6y = T{a ^tZ%~ a) ^ x) ' 

Re /3 > Re a > -1. 
With this integral formula the substitution y = |(1 ± cos 0) yields 

[ Lj^(x(cos9± l))shr"0d0 = 2^ / (1 - y)^ y^ LT^ {±2x ■ y) dy 
Jo Jo 

= 2 JM 2 V (±2x) , (5 . 13) 

r(j + M + i) jV y v 7 

Inserting this into the integral representations (|5.4[) and (|5.5p gives (|5.11|1 and 
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Remark 5.4. The symmetry property K_ a = K a for the if-Bessel functions 
implies that Gty - {x) = fGj' 1 ^) and hence Corollary 15.31 also allows us to 
compute A^'j explicitly: 



A#(x) = 2 -A%j\x) = 2 ^ + ^ x-ie-°L»(2x). (5.14) 



In [5] we show that the functions A^'" always degenerate to polynomials if v 
is an odd integer. For v > 3 these special polynomials do not appear in the 
standard literature. Properties for these polynomials such as differential equa- 
tions, orthogonality relations, completeness, recurrence relations and integral 
representations will be studied thoroughly in [5]. 

Remark 5.5. Corollary 15.31 and Remark 15.41 suggest a relation between the 
fourth order differential equation T>^ M u = \^' y u in the cases where v = ±1 and 
the second order differential equation (see [lj (6.2.8)]) 

d 

da; 2 ' v 1 ' dx 



x ~na +( a + 1 ~ x )— + n ) u = ( 5 - 15 ) 



for the Laguerre polynomials L"(x). In fact, by Proposition 12. II (5) the fourth 
order differential operator T>^.±\ collapses to the simpler form 

£V»,±i = sl,±i - cv,±i 

with second order differential operators 5^,±i and constants C Mi ±i defined in 
Proposition [0(5). 

For fi > — 1 the operator S^.^i itself is self-adjoint on L 2 (R + ,x^dx). It 
has discrete spectrum given by (— (2j + fj, + 1)) j6 n and an easy calculation 
involving (|5.15|) shows that Kfyj is an eigenfunction of S^-x for the eigenvalue 
— (2j + fi + 1). Applying 5^,-1 twice yields the fourth order differential equation 
of Theorem EU for A£~\ 

The same considerations apply for iS^.+i and A^ j (x) since we have the 
relations (|5 . 14[) and 

S^+ix- 1 = x~ 1 S flt - 1 . (5.16) 

Remark 5.6. Similarly to the calculations in [5], where we derive explicit for- 
mulas for the functions A^ if v is an odd integer, one can find the following 
expression for A^'J: 

3 ' jK ' r(i/ + i) ^ i! (^_ i ) !( j + M _ i )!r(i + '^) 

x {2x) l 2 F 2 [i-j-n, + £ , v + 1; 2a; 



where 2-^2(^11 a>2] &ij ^2! z ) is the hypergeometric function. Using this one can 
sharpen the estimates for A3 '^(3;) given in Theorem 14.21 
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6 Recurrence relations 



. Our first recurrence relation involves the first order differential operator 



In this section we will give three types of recurrence relations for the functions 

i,j ' 

H a (a G C) on R + , given by 

a + 2 



H a :=6 

z 

If a £ K, then H a is a skewsymmetric operator on L 2 (R + , x Q+1 da;) since 9* = 
—6 — (a + 2) on L 2 (R + , x a+1 dx). This will allow us to compute the L 2 -norms 
for A%'j explicitly if fi and v satisfy (|IC1|) . 

Proposition 6.1. For /Lt, v £ C, i = 1,2,3,4 we have the following recurrence 
relation in j £ Z 

(2j + fi + l)7WA£f 

= (i + l)(i + „ + 1)A^ +1 - (j + ^) + ^) A^_ r (6.1) 

Proof. As in the proof of Theorem l4.6l we verify (|6.1[) via a partial differential 
equation for the generating function Gf'". A short calculation shows that the 
recurrence relation (|6.ip is equivalent to the partial differential equation 

(2o,+,,+i)k + " + :; +2 W- 



which holds by Lemma [3~T1 (2). □ 
Corollary 6.2. If /i and v satisfy ([PCi~|) , iften 

2A i + i/ - i r(j + i£+^+ 2 .)r(j + i jt ~ v+2 \ 
ll^||i a(Rf , X M+H-idx) = j! (2. ? + At + i 2 )r(j + M + i) 2 ' (6 ' 2) 

Proof. Wc prove this by induction on j. For j = 0, in view of Example 14.11 
and 



x r 



a — fx + 1/\ ( a — fi — v 



(see formula 10.3 (49) in [3] for a = y = 1 and Re a > |Re n\ + |Rc we can 
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calculate 

l|A£ol 2 =/ |A££(z)|V+"+ 1 d a! 



r \K^{x)\ 2 x^ +v+1 dx 



r(^) 



r(H±2)2 



/•GO 

/ ^(aOfar^clx 
Jo 



2 

2* 2^- 1 r(^) 2 r(i^±f±^)r(ii^±^) 



r(^) 2 r( M + 2) 

= (/i + i)r( M + i) • 

For the induction step we reformulate (|6.1[) as 

w am,v_ + + + AM , y (2j + fi + is)(2j + fi - is) 
Hfl+V ^ " 2j + /i+l 2j+1 4(2j + /i + l) 2 ^- 1 

and use the skew-symmetry of Ti^+v on L 2 (R + , dx) together with the 

pairwise orthogonality of the functions A%'j (cf. Corollary 14. 8 1) to calculate 

||?WA^|| 2 = (H^A^H^A^) = - {k^\Hl +v k%) 



A 2j 



0" + !)(■? + A ^ 



2j + n + 1 ' 

(2j + /* + i/)(2j+p-i/) 



4(2j + /i + l) "H^-i 
+ + (2(j + l) + // + i/)(2(j + !)+//-!/) 

2j + a« + 1 4(2(j + 1) + m + 1) 

(2j + M + ^)(2j + M-^) ,, A ^||2 
4(2j + m + 1) ' 2(i-l)+M+l 

On the other hand, orthogonality and recurrence relation also yield 



'(2j + ^ + i/)(2j + ^-^) 



2 

||2 



4(2j + /i + l) 



I A' 1 



2J-H 



Putting both equalities together completes the induction. □ 

Remark 6.3. An easy calculation involving the recurrence relation (|6.1j) shows 
that the explicit expression (|6.2|) for the norms of the functions A^'j is equivalent 
to orthogonality of the sequence (A^ 'J)jefj m i 2 (R+, dx). It seems 
likely that this remains true for arbitrary fj, > v > — 1 (if not both are equal to 
— 1) without the integrality condition pCl[) . but we do not have a proof. 

Formula (|6.2p implies an integral formula for the I- and A'-Bcsscl functions 
which we did not find in the literature: 
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Corollary 6.4. Let ^ < a < oo and [i,v satisfy condition QICip . Then 



\In((a-l)x)\ 2 \Kj i (ax)\ 2 x fl+l ' +1 dx 



{2^y+ v+2 ^ (a - i) 2 ^r(j + ^±f±^)r(j + 2=|±2) 



8 



■E 

3=0 



^i!(2i + /x+l)r(i + M+l) 



Proof. The orthogonality of the A£'" gives 

2 



3=0 3=0 



iGn*,-)f 

tx 



2 V 1 - t 



KiL 



1 - i 



c' l+ ' y+1 da;, 



so that for a := j-zt the desired formula follows from (|6.2[) . 



□ 



The second type of recurrence relations expresses x 2 A?'j as linear combina- 
tion in K^u for k = j — 2, . . . , j + 2. These recurrence relations are an immediate 
consequence of the fifth order differential equation for the generating function 
G^' v given in Lemma HO (3). 



Proposition 6.5. For /j,, v € C we have 



3 + 



H + l 



M + 3 



x 2 A^(x) 



2(j + l)(j + 2)(j + fi+ l)(j + M + 2) [ j + 



8(j + l)(i + /i+l) i + 



2 

M + 2 



A£f +2 (z) 
/i + 3 



A£f +1 (z) 



2i 



3 + 



M + 1 
2 



(«J 4 + 6j 3 + c/ + rf?- + e)Aff(x) 



J + TT U + 



M + 3 



J + 



/i + v 



3 + 



2 J 



M + 3 



i + 



/j + ^ — 2 \ / it — ^ — 2 



H — u 



with a, 6, c, d, e as m Lemma \3.1\ (3). 

Remark 6.6. For j ^ —i! T^' — '2^ the recurrence relation of Proposi- 

tion [^31 can be rewritten as 

x 2 A^(x) = £ o^"(fc)A^ +fc (x) 

fc=-2 



with constants af'^(k). 
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The last set of recurrence relations in the parameters fj, and v are again imme- 
diate with the corresponding differential equations for the generating functions 
which have already been stated in Lemma 13.21 

Proposition 6.7. Let fj,,u € C. With S(i), e(i) as in (|3.8[) we have 

(1) The recurrence relation in fi 

(2) Tfte recurrence relation in v 

v (a?> v (x) - = Hi) (K;r 2 W (f ) 2 a^" +2 w) • 

(3) TTie recurrence relation in n and v 

j- x (A&"(s) - Af'^z)) = *(<)|A^|T(x) + £ (i)|A^ +2 (x). 



7 Meijer's G-transform 

The main result of this section is that the functions A^'J are eigenfunctions of 
a special type of Meijer's G-transform „ if /i and v satisfy pClj) . Our proof 
of this result is based on representation theory and will be given in Section [8j 
We do not know whether the statement also holds for general \i > v > — 1. 
For / € C£°(R+) the integral transform T^ v it is defined by 



Here 



Gn tV {t) :— G 04 i 



' 2' 2' 2 



denotes Meijer's G-function, which was first systematically investigated by Fox 
in [1]. G^j/ satisfies the fourth order differential equation (see 5.4 (1)]) 

o(o + l)(e + l){e + ^-)u(t) = Ht). (7.1) 

For y = — 1 the G-function reduces to a J-Bessel function 

G^it) =t-$J li (Ui) 

and the operator ^u,-i becomes a Hankel transform. 

The following statement can also be obtained from representation theory in 
the case that and v satisfy pClj) (sec Section [FJ for a proof). 

Proposition 7.1. Suppose fx, v > — 1 are not 6ot/i eguaZ to —I. 

(1) 7^ jt/ extends to a unitary involutive operator on L 2 (R + ,x' 1+u+1 dx). 

(2) TTie G-transform T^v commutes with the fourth order differential operator 
T>„„. 
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Proof. (1) It is proved in [3] that 



Tf(r) :=- [°° G^((rr')i)f(r')dr' 
c Jo 

defines a unitary involutive operator T : L 2 (R + ) — ► L 2 (M. + ) for c = 

t±^±l > o. Then the coordinate change ?~ = (§) C , r ' = (2) ° § ives tne 
claim. 

(2) A short calculation using that is a symmetric operator in L 2 (M. + , x ^ +u+1 dx) 
gives the desired statement if one knows that the G-function satisfies the 
following differential equation 

X V\ 2 \ r<n \ n (f x D^ 2 



2\ / / \ 2 



But this is easily derived from 

«.^((x) 8 ) =2 (^)((f) 2 ) 

using the expression (|2.ip for and the differential equation (|7.ip for 
the G-function. □ 

Theorem 7.2 (Meijcr's G-transform). Suppose that fi and v satisfy (IIC1|) . 
T/ien /or eac/i j £ No the function A^'J is an eigenfunction of Meijer's G- 
transform T^ v with eigenvalue (— 1) J . 

Remark 7.3. In Remark 15.51 we noted that for v = — 1 the functions Aj'" 1 
are eigenfunctions of the self-adjoint second order differential operator <S^,-i on 
L 2 (R + ,x^ +v+1 dx). In P Theorem 4.1.1] Kobayashi and Mano proved that, if 

fj, is an integer, the operator e 2 ^j*.- 1 , defined via spectral theory, is given as 



One can use Theorem 17.21 to obtain an integral formula for the generating 
function G% v and hence for the Bessel functions involved similar to the one in 



Corollary [ 

Corollary 7.4. Let | < a < 00, j3 = 2 a-i an ^ assume that A* an d v satisfy 
condition (|IC1[) . Then for x > 

((^) 2 ) 7 f ((« - l)y) /? § (ay) dy 

PROOF. By Theorem 17.21 we have 

= i'^Kj for every 3 e N . 
Taking generating functions of both sides yields 

C^iOa, G% v (t, x) = G%' v (-t, x), 
and this gives the desired formula for a = j^-r . □ 
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8 Applications of minimal representations 



In this section we complete the proofs of Proposition 12.11 (4) and Theorem 17.21 
using representation theory. 

There is a long history of research on the interactions of the theory of special 
functions and representation theory, in particular, related to the analysis on 
homogeneous spaces of Lie groups. Our fourth order differential operator T)^^ 
is also motivated by group representations. The general features in our setting, 
however, are quite different from the traditional analysis on homogeneous spaces. 

In fact, we are dealing with an 'extremely small' infinite dimensional repre- 
sentation, sometimes referred to as the minimal representation, for which the 
whole group cannot act on the geometry of the L 2 -model (the Gelfand-Kirillov 
dimension of the minimal representation is too small for that). Hence Lie algebra 
action here is not just given by vector fields, but involves higher order differ- 
ential operators. (In our particular example second order suffices.) We shall 
prove in Theorem 18.11 that the fourth order differential operator comes 
from the Casimir operator when both /i and v are integers > — 1. We shall also 
discuss the underlying algebraic structure of various formulas on (A^'J)., such 
as recurrence relations (Theorem E) and Meijer's G-transforms (Theorem D) in 
connection with representation theory. 

In the converse direction, the theory of special functions developed in this pa- 
per allows us to interpret the functions A^'J as a basis for the space L 2 (G) ra d of 
iC'-spherical vectors (see (|8.ip ) and hence contributes to representation theory. 

We adopt the notation of |7j. In particular, we assume that p > q > 2 are 
integers of the same parity and p + q > 6. With jj, = p — 3, v = q — 3 this is 
equivalent to fi > v > —1 being integers with the same parity not both equal 
to —1, i.e. to the integrality condition (jlCljl . 

Consider the indefinite orthogonal group 

G := 0(p, q) = {g £ GL(p + q, K) : V M <? = W 
of signature (p, q) , where 




Then G is a semisimple non-compact Lie group. In [5] Kobayashi and 0rsted 
construct an L 2 -model of the minimal representation ir of G, which is an analo- 
gon of the classical Schrodinger model of the Shale-Segal- Weil representation of 
the metaplcctic group. More precisely, it is an irreducible unitary representation 
on the Hilbcrt space L 2 {C) = L 2 (C, d/i), where 

G = K e w + i- 2 \ {0} : d 2 + • • • + C P 2 -! - C 2 Cp 2 +9 - 2 = 0} 

is an isotropic cone in M. p+q ~ 2 and dfj, an 0(p — 1, q — l)-invariant measure on 
G. Let wq := I p ^ q . The unitary operator Tc '■= tt(wo) pl avs a r ole of the Fourier 
transform on the isotropic cone G. We call Tc the unitary inversion operator. 
On the isotropic cone G, we set 

r ■= ^c 1 2 + --- + c 2 - 1 = v / Cp 2 + ---c P v 2 . 
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Then the pull-back of the projection r : C — ► R+ induces an isomorphism of 
Hilbert spaces 

L 2 (R + , V+^ 5 dr) i 2 (C) rad C L 2 (C), (8.1) 

where £ 2 (C) rac i stands for the closed subspacc of L 2 (C) consisting of radial 
functions, or equivalcntly, functions that are invariant by K' := 0(p — 1) x 
0(q — 1). Elements of £ 2 (C) ra d are called K' -spherical vectors. To justify this 
name consider the bipolar coordinates which parameterize the cone C: 

R+ x § p ~ 2 x S q ~ 2 — ► C, (r.w.Tj) ^ (rw,rr?), 

where § n_1 denotes the unit sphere in K n . Then the action of K' = 0(p — 
1) x 0(q — 1) is given by rotation in the spherical variables co and r\. Hence, 
if-spherical functions are those depending only on the radial part r. 

We take a negative definite bilinear form Bono (n) which is invariant under 
the adjoint action and turns {Ei j — -EjvjKi^Xn into an orthonormal basis with 
respect to —B. Restriction to the Lie algebra i = o(p) © o(q) of the maximal 
compact subgroup K := 0(p) x 0(q) of G yields the Casimir element 

£1 = - 2J ( Ei >i ~ E i^ 2 ~ X] ( Ei >i - -^i^) 2 - 

The fourth order differential operator £> Ml „ with integral p and ^ arises from 
the Casimir action on the minimal representation as follows. 

Theorem 8.1. Suppose p, q > 2. Under the coordinate change x := 2r the 
operator 2d7r(f2) acts on L 2 (C) Ya d as the differential operator £> p _3 ig _3. 

Proof. The group if' acts trivially on L 2 (C) ra( j and so does its Lie algebra 6'. 
Let fi' be the Casimir element for 6'. Then, the action of f2 on L 2 (C) ra d is given 

by 

dTr(n) = dir{n) - dir{n') 

p— 1 p+q— 2 

By [3 (2.3.15) and (2.3.19)] the Lie algebra action is given by differential oper- 
ators in the ambient space M. p+q ~ 2 along C as 

d%(E 0tj - E j)Q ) = ^40 + On ~ (2£ + n - 2) A 



'ac 



for 1 < j ' < p — 1 and similarly 



dvr(i^ +g _i - iWu) = (40 + GO + (2£? + n - 2) A 

for p<j<p + q — 2, where 

a 2 a 2 a 2 a 2 



□ 



ao 2 ac 2 _ x ac 2 ac 2 +9 _ 2 



a 
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Applying the operator d7r(0) to a radial function f(r) gives the desired result. 

□ 



The reason why the Casimir operator dn(£l) is a differential operator of 
fourth order rather than of second order is the fact that the group K = 0(p) x 
0(q) cannot act continuously in a non-trivial fashion on the cone C, whereas 
the smaller group A ' C A does. 

If one restricts the representation to the maximal compact subgroup K = 
0{p) x 0(q) C G one has the following multiplicity- free decomposition of n into 
A-irreducible representations 



with 



a=0 



Here HP(W 1 ') is the space of spherical harmonics on W 1 of degree j, on which the 
orthogonal group 0(n) acts irrcducibly. The branching laws for 0(n) J, 0(n— 1) 
(n > 2) show that the 0(n — l)-fixed vectors in W J '(K n ) form a one-dimensional 
subspace. Hence, if one restricts to the smaller subgroup A' = 0(p — 1) x 
0(q — 1) C A', then the A'-spherical vectors in each A-type V a form a one- 
dimensional subspace V a fl L 2 (C) ra d. Considering only the radial functions in 



()8.2|) we obtain 

oo 

L 2 (C) rad ~^(rni 2 (C) ra(1 ), (8.3) 

a=0 

because the property of being radial is determined by the subgroup A' of K. 
We will show that each subspace V a n A 2 (C) ra d is spanned by Af- 3 ' 9 ~ 3 (2r). 
In order to do so we observe that by Schur's Lemma the Casimir clement 
acts as a scalar on each A-type V a , because f2 is central in the universal 
enveloping algebra U(t). In fact, representation theory of the compact group 
K = 0(p) x O(q) shows that fJ acts on V a by 

«(« + P 2) + (a + P —«) (a + P -±^) . (8.4) 



Now we are ready to prove that the differential operator T>^ v is self-adjoint. 

Proof of Proposition 12.11 (4). By [lU Theorem 4.4.4.3] the Casimir cle- 
ment ft defines a self-adjoint operator on the representation space L 2 {C). On the 
other hand, the element —2£1 acts on L 2 (C) ra d as T>^^ by Thcorcm lS.U Hence 

extends to a self-adjoint operator on the space L 2 (C) ra d = L 2 (IR + , dx) 
of radial functions. The decomposition (|8.3|) is discrete, so the spectrum of T>n, v 
is discrete and given by twice the eigenvalues (|8.4|) of the Casimir element which 
in view of j = a, fj, = p — 3, and v = q — 3 are given by 

Ar = 2i(i + M + D + 2(i + ^) + 

Since the spaces V a n L 2 (C) ra d in (|8.3p are one-dimensional and the (Xj^)j^ 
is strictly increasing, the L 2 -eigenspaces of T>^ M are also one-dimensional. □ 
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For the L 2 -model of the minimal representation, it is in general a difficult 
problem to find explicit if -finite vectors (see [HI Introduction]). Theorem 18.11 
implies that the functions A^'" (j = 0, 1, 2, . . .) for integers > v of the same 
parity are indeed if-finite vectors of the minimal representation tt. More pre- 
cisely, we have: 

Corollary 8.2. For every j € No, the space nL 2 (C) ra d is one- dimensional. 
It is spanned by A??" 3 ' 9-3 ^?"). 

PROOF. We have already seen in Theorem 14.61 that the functions A2~ 3 ' 9 ~ 3 (x) 
are eigenfunctions of T> p s,q-3 in L 2 (R + , ^r p+q ~ 5 dr) for the eigenvalues \P~ 3 'i~ 3 _ 
Hence, A2~ 3 ' 9_3 (2r) is an eigenfunction of the Casimir operator dir(fl) for the 
eigenvalue (|8.4p . Since all those eigenvalues are distinct, the claim follows. □ 

Remark 8.3. (1) For q = 2 (p and j arbitrary), we saw in Corollary 15 . 3 1 that 

A P-3, 9 -3 (2r) = congt . L P-3 (4r)e -2r^ 

In this special case Corollary 18.21 was already proved in [HI Proposition 
3.2.1 (2)]. 

(2) For j = (p and q arbitrary) Example 14. II gives 

A 2^ 3 ' 9 ~ 3 0) = const • #£-3 (2r). 

This bottom case of Corollarv IS . 21 was already found in [5] Theorem 5.8 (1)] 
by taking theFourier transform of the 'conformal model' of the minimal 
representation. 

The relation of the G-transform considered in Section [7] to representation 
theory was found by Kobayashi and Mano in [TJ. 

Theorem 8.4 ([7J Theorem 4.1.1]). Under the coordinate change x = 2r the 
unitary involution operator Tc acts on L 2 (C) ra d as the G-transform (— l) £ 2~ 2 7^_3. g _3. 

In the case that /i = p — 3 and v = q — 3 satisfy (|IC1[) we can now give an 
alternative proof of the results of Proposition 17.11 using representation theory. 
By Theorem 18.41 the operator 7^>_3. g _3 is given as the restriction of the unitary 
inversion operator Tc = tt(wq) to L 2 (C) ra d. This shows that 7^_3 :(Z _3 defines 
a unitary operator on L 2 (R + , dx). Furthermore, since wq normalizes 

(actually, centralizes) the Lie algebra t, wo commutes with the Casimir operator 
fi. Therefore, in view of Theorems 18.11 and 18.41 also 2? p _3 i9 _3 and 7^_3. 9 _3 
commute. 

Theorem 18.41 also allows us to give the announced proof of the fact that the 
functions A^" 3 ' 9-3 are eigenfunctions of Meijer's G-transform. 

Proof of Theorem 17.21 It is observed in [7J Proof of Theorem 3.1.1 (3)] that 
wq acts on each K-type V a as (— l) a+£ r a . Since A2~ 3,9_3 (2r) is a X-finite vector 
in the if- type V a by Corollarv l8.21 the statement follows from Thcorcm l8.4l □ 

Finally, we can also give a representation theoretic explanation for the re- 
currence relations in Propositions 16 . ll and 16 . 51 Using the notation of [7J we con- 
sider the Langlands decomposition of the maximal parabolic subalgebra p max of 
g = Lic(G): 

pmax = m max + fl + n , nax ^ 
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m max is the Lie algebra of 0(p — l,q — 1) which acts on the geometry C . The 
abelian part o is one-dimensional and spanned by H G a which acts on L 2 {C) 
as the first order differential operator 



where E is again the Euler operator. Hence H acts on radial functions as 
the differential operator — H p + q -6 (see Section Finally n max is spanned by 
Ni, . . . , Np+g-2 <G n max wnose action is given by the multiplication operators 

dxiNj) = 2V=1&-. 

In particular, the sum of squares space of 

radial functions £ 2 (C) ra d invariant. 

The key to an understanding of the underlying algebraic structure of the 
recurrence relations in Propositions 16.11 and 16.51 is the action of H and Nj on 
the /v-types V a . For convenience put V^ 1 := 0. 

Lemma 8.5. The Lie algebra action dir(X) : 0^ o V a — > 0^1 o V a (X e g) 
induces the following linear maps for each a € No : 

dn{H) : V a — ► V a+1 © F a_1 , 

dTr(lVj) : V a — > V a+1 © F a © V a -\ l<j<P + q-2. 

Proof. Let g = 6 + p be the Cartan decomposition of g determined by the 
choice of t. For X € t we have 

dTTpf) : V a — ► V a (8.5) 

since V a is a -ff-module. For the action of p consider the if-module homomor- 
phism 

p © V a — > L 2 (C), X®<p^ dir(X)ip, 

where K acts on p by the adjoint action. To determine which JC-types appear 
in the image one has to decompose p © V a into simple i^-modules. Let M 
denote the outer tensor product representation. Since p = 7i 1 (M p ) H7i 1 (K l? ) as 
-RT-modules, we find 

p®V a ^ {H 1 {W)®H a {W))m{H 1 {R q )®H a+I ^{M q )). 

Using branching rules for tensor products of 0(n)-modules (see e.g. [6]) one 
obtains that 

W 1 (R n ) ® H a {R n ) = H a+1 (R n ) © H^iW 1 ) © W, 

where H~ 1 (M n ) := and W is either or an irreducible 0(n)-module which is 
not isomorphic to any of the H. k (M. n ). Hence 

p ® V a S (W a+1 (M p ) © W"- 1 ^') © VFi) IS (W a+1+£ ? 1 (R«) © W -^^ (R9) © W 2 ) 

= (H a+1 (R p ) HH a+1+£ ? l (IR <z )) © (H a ~ l (R. p ) 8W°- 1+s r(M 9 )) © W 
F a+1 © y 2 " 1 © W, 
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where W is a sum of simple A'-modules that do not appear in n, i.e. different 
from the V\ j £ No- Hence for X 6 p we have 

dTr(X) : V a — ► V a+1 © V a -\ (8.6) 

Putting (|8.5p and (|8.6j) together proves the claim since H 6 a C p. □ 

Note that both d7r(if) and J^^j -2 d7r(Aj) 2 leave L 2 (C) ra d invariant. Since 

V Aa nL 2 (C) ra d is one-dimensional and spanned by A2~ 3,9_3 (2r) for every a £ No, 
we obtain 

H p+q ^A p 2 - 3 ^ 3 e span{A^ 3 ^- 3 : fc = j - 1, j + 1}, 

a^ 3 ''- 3 6 span{A^ 3 ^ 3 :k=j-2,j- + + 2}. 

which can be viewed as qualitative versions of Propositions 16.11 and 16.51 
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